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CERTAIN  PROBLEMS  OF  THE  THEORY  OP 
STATISTICAL  LINEARIZATION  AND  ITS  APPLICATION 

I.  Ye.  Kazakov 

Summary 

We  will  examine  the  general  aspects  of  the  theory  of  statistical 
linearization  based  on  the  approximation  of  an  arbitrary  nonlinear 
transformation  of  a  random  function  by  an  equivalent  linear  operator. 
Applications  of  this  theory  to  an  analysis  of  the  accuracy  of  nonlin¬ 
ear  automatic  control  systems  are  given.  Practical  methods  of  deter¬ 
mining  the  equivalent  operator  for  a  nonlinear  transformation  of  ran¬ 
dom  functions  are  recommended. 

Introduction 

A  theoretical  probability  analysis  of  the  accuracy  of  nonlinear 
dynamic  systems  In  the  pzvsence  of  remdom  disturbances  Is  a  very  com¬ 
plex  ifroblem.  As  a  oonsequenoe  of  this*  of  considerable  praotloal  In 
portance  for  the  Investigation  and  designed  of  nonlinear  control  sys¬ 
tems  Is  the  approximate  method  of  statistical  linearization  of  nonlln 
ear  transformations  which  has  been  developed  and  Is  widely  used  now 
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[1,  2].  This  method  Is  reasonably  slnqple  In  a  practical  applleatim 
since  the  principal  calculations are  performed  by  using  the  well -devel¬ 
oped  linear  theory  of  transformation  of  random  functions.  This  is  the 
main  practical  virtue  of  the  approximate  method. 

However,  the  method  of  statistical  linearization  of^nonllneer 
transformatlonswas  developed  for  nonli»iear  Inertla-free  elements  and 
Is  Inapplicable  to  more  complex  nonlinear  transformations.  In  addition 
It  does  not  take  Into  account  the  spectrum  change  Of  the  random  func¬ 
tions  at  the  output  of  the  Inertla-free  element,  which  Is  of  interest 
In  certain  cases  of  the  calculation  of  dynamic  systems. 

The  elimination  of  these  shortcomings  Is  possible  by  the  general¬ 
ization  of  the  existing  method  of  statistical  linearization  based  on 
the  tise  of  the  general  theory  of  approximation  of  random  functions 
[3,  4].  In  this  repoiM;  we  have  developed  a  series  of  statistical  lin¬ 
earization  of  nonlinear  operators  of  a  general  form  on  the  basis  of  a 
quadratic  approximation  of  the  transformed  random  function.  The  iqp- 
pllcatlon  of  this  theory  to  analysis  of  closed  nonlinear  continuous 
and  discontinuous  automatic  control  systems  Is  examined. 

1.  General  Aspects  of  the  Theory  of  Statistical 
Linearization  of  Nonlinear  Transformation 

Let  the  random  function  l(t)  be  related  with  the  random  function 
X(t)  by  a  nonlinear  transformation  of  the  general  form 

V'(0-/|X(T).  /|. 

The  function  f  Is  an  arbitrary  nonllnfeficr  function  charaetezdjdlag 
the  nonlinear  transfonnation  realizable  over  the  Ainetlon  X(t)  for  Ob¬ 
taining  the  function  Y(t).  In  particular  this  can  be  a  siatic 
acterlstlc  of  an  Inertla-free  nonlinear  elmaent  without  a  and  wltii 
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a  lag  or  a  solution  of  a  nonlinear  equation  of  arbitrary  fdrm 


where  F  Is  a  nonlinear  function 
d 


P(/.  ^)y  -  F((.  Y.  Y- . V".  X . X"").  (1. 2) 

;  P  ^t,  Is  a  polynomial  relative  to 


aF 


with  variable  coefficients. 


In  the  general  case  the  form  of  the  function  £  describing  the  be¬ 
havior  of  the  output  value  of  some  dynamic  systems  can  be  unknown.  In 
such  a  case  the  dynamic  system  should  be  defined  physically  as  a  com¬ 
plex  of  apparatus  and  the  form  of  the  function  f  relating  the  output 
value  Y(t)  with  the  input  value  X(t)  should  be  determined  experiment¬ 
ally. 

We  will  approximate  the  nonlinear  transformation  (1. l)  by  a  lin¬ 
ear  dependence  between  the  random  functions  selected  on  the  basis  of  a 
certain  criterion  of  the  best  approximation  of  the  random  fxmctlon 
Y(t)  by  a  linear  operator  applied  to  the  randcan  function  X(t).  Let 
us  represent  the  random  function  X(t)  and  Y(t)  as 


X  (/)  =  /«.  (/)  X»(/); 

r(/)  =  mi,(/)-i  y{/). 


(1-5) 


where  m^(t),  ®y(t)  are  the  mathematical  expectations  of  the  correspond¬ 
ing  random  functions  Including  the  regular  components;  X°(t)  and  Y®(t) 
are  centered  random  functions. 

We  will  represent  the  approximating  function  U(t)  as 


(/(t)  =  m„(0  +  y(0- 


(1.5) 


Ihe  mathematical  expectation  oi^(t)  and  the  random  component  U®(t)  of 
the  function  U(t)  will  be  represented  In  the  form 


(1.6) 
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(1.7) 


U'>(l)^k,\W(l,x)X*{x)dx, 
r 

where  ko  and  ki  are  the  statistical  coefficients  of  anqpllflcatlonj 
W(t«  r)  Is  the  weight  function  of  the  linear  system  realizing  the  op¬ 
timal  approximation;  T  Is  the  region  of  the  change  of  the  variables 
t  and  T  or  the  Interval  of  the  observation  of  the  function  X(t). 

For  practical  purposes  we  can  consider  two  criteria  of  the  lin¬ 
ear  approximation  of  random  functions.  The  first  criterion  consists 
of  fulfilling  the  condition  of  equality  of  the  mathematical  expecta¬ 
tions  and  the  correlation  function  of  the  true  and  approximate  random 
function.  The  second  criterion  consists  of  fulfilling  the  minimum 
condition  of  the  mean  square  value  of  the  difference  of  the  true  and 
approximate  random  functions. 

By  using  the  first  criterion  we  derived  the  following  equation 
for  determining  Kot  Ki,  W(t,  t): 

T)/n,{r)dT;  (1,8) 

r 

K»(J.  t)  =  A,  (S)  A,  (/)  ji  ji  US'  (5,  T)  W  (t.  X')  Km  (t.  t')  dxdx\  (i.  9) 

r  V 

where  K(s,t),  t')  are  the  correlation  functions  of  the  random 

functions  of  Y  and  X  respectively. 


Fig.  1.  Equivalent  linear  trans¬ 
formation. 


By  using  the  criterion  of  the  minlmuffl  of  the  root  mean  square 
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error  at  any  af  T 


Af  {|y  (»)-(/ (*)!•) -.miH, 


we  will  obtain  for  determining  the  optimal  linear  approximate  operator 
the  equation  [4] 


(T,  I)  W  (*,  T)  dt  +  ntt  (/)  X  (*)  -  0, 


(1.10) 


where 


4(») -«»(•)-*, Jr(*,  t)m^(t)dT.  (1.11) 

Therefore  the  nonlinear  tranaformation  of  the  general  fom  (1.1) 
of  the  random  function  X(t)  la  replaced  by  two  linear  operatlona  over 
the  mathematical  expectation  and  random  components »  as  shown  In  I^ig.  1. 

For  a  complete  determination  of  the  equivalent  linear  traneforma* 
tlon  we  muat  Indicate  a  method  of  calculating  the  coefficients  ko  and 
ki  aa  well  aa  a  method  for  finding  the  weight  function  W(s>  t). 

When  approximating  with  respect  to  the  first  criterion  we  will 
detemlne  ko  I'rom  the  condition  (1.8) 

•  ^  •  (1.12) 


We  will  take  coefficient  ki  equal  to 


(1.13) 


The  weight  v(8,  t)  should  be  determined  from  the  quadratic  Integral 
equation  (1.9)« 

Wien  approxlMtlng  aoeordlng  to  the  aeeend  criterion  we  have  one 
equation  (1.10)  for  detenalning  the  three  characteristics  ke^  ki« 

V(t,  t);  therefore,  it  can  also  be  dealt  with  by  selecting  two  coef¬ 
ficients  ko  and  ki.  ¥e  will  deternOne  coefficient  ko  In  the  same 


manner  as  In  the  first  case,  by  expression  (1.12).  The  coefficient 
ki  will  be  determined  In  the  following  manner: 


*i(0 


«„(/,/)  • 
Af,  (<.0  ' 


(1.14) 


When  determining  the  coefficient  ko  on  the  basis  of  equality 
(1.12),  condition  (1. ll)  becomes  the  following: 


X(*)sO. 


(1.15) 


On  the  strength  of  equality  (1.15),  equation  (I.IO)  for  determin¬ 
ing  the  weight  function  W(s,  t)  takes  the  form 

J  K,  (T.  t)  r  (S,  T)  dt  =  K,x  (s.  /).  (1. 16 ) 

Therefore,  the  determination  of  the  approximate  linear  operator 
reduces  to  a  solution  of  equation  (1.16)  and  a  calculation  of  the  co¬ 
efficients  ko  and  ki  by  formulas  (1.12)  and  (1.14)  at  given  Ky^(8,  t), 

K3j(t,  t),  my(8),  injj(T). 

Of  practical  Importance  Is  the  case  where  the  Internal  of  observa¬ 
tion  of  the  random  function  X(t)  Is  a  seml-lnflnlte  Interval 
—  «  <  t  <  T.  Then  equation  (1. 16)  when  s  c  T  takes  the  form 

f 

5  AC,  (T.  /)  W  (5.  T)  dt  =  ^  K,.  (s.O-  ( 1- 17  ) 


2.  Equivalent  Linear  Trans fomat Ions  for 
a  Nonlinear  Circuit 

As  was  shown  above  the  finding  of  an  equivalent  linear  transforma¬ 
tion  lies  In  calculating  the  coefficients  k©  and  ki  and  In  a  solution 
of  equation  (1.9)  relative  to  W(8,  t)  when  approximating  with  respect 
to  the  first  criterion  or  equation  (1.16)  when  approximating  according 
to  the  second  criterion. 
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When  approximating  according  to  the  first  criterion  a  direct  aoI> 
utlon  of  equation  (1.9)  In  the  general  case  Is  difficult.  However, 

In  the  special  case  where  the  Interval  of  the  change  of  variables  Is 
seml-lnflnlte  and  the  functions  X(t)  and  Y(t)  are  stationary,  the 
equivalent  weight  function  on  the  basis  of  (1.9)  can  be  determined  by 
the  following  expression: 

oo 

where 

(2-2) 

0  (<o)  la  the  srectral  density  of  the  random  function  Y(t); 

y 

Qj^(<u)  la  the  spectral  density  of  the  random  function  X(t). 

The  determination  of  the  weight  function  W(s,  t)  by  the  second 
criterion  In  the  general  case  based  on  equation  (l.l6)  at  given  func¬ 
tions  Ky3j(8,  t)  and  K3^(t,  t)  Is  possible  by  using  the  Integral  canon¬ 
ical  concepts  of  random  function  [5).  In  the  special  case  of  practi¬ 
cal  Importance,  where  the  function  X(t)  Is  given  for  a  seml-lnflnlte 
Interval  —  «  <  t  <  T  In  the  form  of  an  Integral  canonical  presenta¬ 
tion 

I 

X*{t)^  ^Z{k)u{l.k)d\,  (2.3) 

— OO 

where  Z(x)  Is  white  nqlse  with  a  correlation  function  equal  to 

% 

/C/(X.  |i)-0(X)6(l-|i).  (2.4) 

and  u(t,  X)  Is  the  weight  function  of  a  certain  linear  syatea  trana- 
formlng  white  noise  Z(X)  to  the  random  function  X^(t),  the  solution  of 
equation  (1.17)  takes  the  fora  [Sls 

^ “  \  \  i  'f**^*- '  (2. 5) 

-io 
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where  u”(X,  t)  is  the  weight  function  of  the  reverse  system  transform¬ 
ing  the  random  function  X  to  white  noise  Z;  0(X)  Is  the  density  of  the 
dispersion  of  white  noise  Z. 

In  an  even  more  particular  case«  If  m^  *  const «  the  function 
X®(t)  Is  stationary  and  function  Y®(t)  Is  statlonarlly  related  with 
X®(t),  thenj  as  shown  In  [3]  and  [3]*  the  solution  of  equation  (1.17) 
takes  the  form 

00 

(2.6) 

where 

(iw)  =  ^ ^ ^ e-'-' dl  ^  di;  (2.7) 

•  —00 

a^((o)  ■  Y(l<o)  Y*(la))  Is  the  spectral  density  of  the  random  process 

X^(t)j  0„(co)  Is  the  mutual  spectral  density.  Here  the  coefficients 
yx 

ko  and  ki  are  determined  by  the  following  fozmulas: 


K,.(0) 

k,(0) 


»  ^  “ 


Jr(T)rfT 

o 


(2.8) 


3.  Equivalent  Linear  Transformation  for  Nonlinear 
Inertia -Free  Element 

The  characteristic  of  a  nonlinear  Inertla-free  element  Is  the 
simplest  nonlinear  function.  This  form  of  nonlinear  transformation 
has  been  studied  In  detail  In  works  on  statistical  linearization. 

Such  an  elementary  nonlinear  transformation  can  be  approximately  re¬ 
placed  by  an  Inertla-free  linear  transformation  with  with  amplifica¬ 
tion  coefficients  (transmission  factor)  ko  and  ki  respectively  for 
the  mathematical  e3q)ectatlon  and  the  random  component.  This  cozres- 
ponds  to  the  condition  V(t»  t)  ■  6(t  —  t)  In  fomiulas  (1.6)  and  (1*7)* 
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However,  to  solve  certain  problems  we  need  a  more  accurate  ap¬ 
proximation  of  the  nonlinear  Inertla-free  transformation  based  on  the 
above-mentioned  theory. 

Of  practical  Importance  Is  the  case  of  a  stationary  Input  signal. 
Then  with  a  stationary  characteristic  of  the  nonlinear  element  on  the 
basis  of  the  first  criterion,  the  coefficients  ko  and  ki  are  deter¬ 
mined  by  the  expression 


t 


1 


(3.2) 


The  frequency  characteristic  and  the  weight  function  of  the  equiv¬ 
alent  linear  operator  are  determined  by  formulas  (2.2)  and  (2.1). 

To  use  formula  (2.1)  we  must  know  how  to  calculate  the  function 
0  (tu)  for  the  nonlinear  element.  This  last  operation  can  be  performed 

J 

fairly  simply  by  assuming  a  two-dimensional  normal  distribution  law 
of  the  randcmi  function  X(t)  at  the  Input  to  the  nonlinear  element.* 

(3.3) 


v(*i.  **)  = 


^exp 


2«(^  j/’l-ikiCt) 

(jfi  —  m,)»  +  {xt  —  m,)*  —  2*,  (t)  (X,  —  «,)  {xt  —  m,) 


29;M-*t(t)l 


Keeping  In  mind  the  known  expansion  of  the  function  of  the  normal 
distribution  Into  a  series 


-  *  •  TTP  ! - ^  + 1>*  Ztjry  I  1  y  (■ 


«<*- 


(3.4) 


we  can  obtain  reasonably  simply  the  expression  for  the  spectral  density 
Oy,(tt))  in  the  form 


*  In  the  general  case  of  arbitrary  distribution  we  must  use  an 
orthagonal  expansion  of  this  law  Into  a  series  based  on  the  normal 
distribution. 
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(3.5) 


"  A*  I 

VI  < 


(x)r^>"dx. 


where 


— «0 

00 

**(t)  =  -^  5  C,(«i>)«'“*dw, 


and  f  Is  the  characteristic  of  the  nonlinear  element. 

When  applying  the  second  method  for  determining  the  equivalent 

linear  operator  In  the  stationary  case  to  the  Inertla-free  nonlinear 

element  we  must  use  formulas  (2.6),  (2.7)*  and  (2.8).  The  calculations 

by  these  formulas  require  a  preliminary  determination  of  the  fvmctlon 

a  (co)  for  which  we  need  the  coupling  moment  of  the  functions  y(t) 
xy 

and  X(t).  The  coupling  moment  can  be  determined  by  calculations  with 
the  given  two-dimensional  law  of  the  distribution  of  randan  function 
X(t)  or  experimentally. 

It  Is  necessary  to  note  that  In  the  normal  two-dimensional  dis¬ 
tribution  law  of  the  function  at  the  Input  to  a  symmetrical  inertla- 
free  nonlinear  element,  as  Booton  showed  [l],  the  coupling  moment  of 
the  input  and  output  random  functions  Is  proportional  to  the  correlar 
tlon  function  of  the  Input  random  function.  This  means  that  the 
equivalent  linear  operator  In  this  case  Is  Inertla-free  and  can  be 
characterized  by  two  coefficients;  k©  and  ki. 

The  equivalent  linear  transformation  for  the  Inertla-free  nonlln)- 
ear  element  for  the  first  criterion  has  recently  been  Investigated  by 
a  number  of  authors.  From  these  Investigations  and  fron  an  analysis 
of  the  results  of  the  calculations  by  formulas  (2.7)*‘(2.8)  we  can  make 
only  preliminary  conclusions  that  approximation  of  Inertla-free 
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nonlinear  transformation  with  respect  to  the  first  criterion  more  ac¬ 
curately  reproduces  the  first  two  probability  momenta  of  random  func¬ 
tions  In  complex  circuits  containing  the  given  nonlinear  element. 

4.  A  Practical  Method  for  Detemlnlng  the  Equivalent 
Lineal-  Transformation  for  Nonlinear  Circuits 

As  follows  from  what  has  been  stated  above,  the  equivalent  lin¬ 
ear  transfomatlon  for  a  nonlinear  circuit  can  be  determined  If  the 
probability  characteristic  of  the  random  function  at  the  Input  and 
output  of  the  circuit  are  given.  Here  the  equivalent  linear  trans¬ 
formation  will  depend  on  the  fom  of  the  nonlinear  circuit  and  on  the 
probability  characteristics  at  the  random  function  at  the  Input. 

It  follows  from  physical  considerations  of  the  transfomatlon  of 
the  random  function  by  a  nonlinear  circuit  that  the  equivalent  nonlin¬ 
ear  transfomatlon  little  depends  on  the  fom  of  the  correlation  func¬ 
tion  at  the  Input.  These  considerations  pemlt  us  to  detemlne  the 
equivalent  linear  transfoimatlon  of  a  nonlinear  circuit  In  a  certain 
fom  of  the  random  function  at  the  input  to  the  nonlinear  circuit  hav¬ 
ing  a  correlation  function  of  the  6 -function  type.  Stationary  white 
noise  X(t)  has  such  a  correlation  function. 

K(T.0“2flC,6(T-0:  (4.1) 

where  Go  Is  the  spectral  density  of  white  noise,  2TrtJo  Is  Its  dlsper- 

* 

Sion  density.  In  this  case,  keeping  In  mind  that  the  dispersion  of 
white  noise  Is  Infinite,  we  will  replace  I^(t,  t)  In  fomula  (1. 14) 
by  th«  oorraspondlng  dispersion  density  PirGo*  !nien  we  obtain 


Substituting  expressions  (4.1)  and  (4.2)  Into  equation  (I.I7),  we  will 
reduce  It  to  the  form 

“'(‘•O-feCT-  (“•5) 

Introducing  the  designation 

t)  “  0  (4.4) 

for  the  normalized  correlation  function  and  showing  explicitly  the 
dependence  of  V(b,  t)  on  the  probability  characteristics  and 
6^  »  •)2TrOo  of  the  Input  disturbance  of  the  nonlinear  circuit,  we  can 
rewrite  formula  (4.3)  as 


if'  (s,  /,  /rij,.  0,)  (s,  /).  (4.5) 

The  weight  function  W  found  depends  on  m^^,  6^  and  on  the  form  of  the 
nonlinear  circuit.  The  function  l<:y^(8,  t)  at  different  values  of  m^^ 
and  5^  for  this  circuit  can  be  obtained  experimentally  upon  the  effect 
on  the  Input  of  the  circuit  of  white  noise  with  variable  characteris¬ 
tics  and  6^. 
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Fig.  2.  Experimental  determination 
of  the  equivalent  weight  function  of 
a  stationary  nonlinear  circuit. 


If  the  nonlinear  circuit  Is  stationary  and  the  mathematical  ex¬ 
pectation  of  Its  Input  disturbance  Is  constant,  then  foxnula  (4.3) 
will  yield  a  stationary  weight  function 


W  (T,  m,,  8,)  —  *iw(t)- 
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Such  a  weight  function  corresponds  to  the  frequency  characteristic 

Ob 

0(i<i),  5 irCt,  o,)r-'-»dT.  (4.7) 

0 

This  formula  can  be  obtained  from  expressing  (2.7)  If  we  take  Into 
account  that  In  the  case  under  consideration  f  (ico)  ■  T*(i(o)  ■ 

Let  us  rewrite  expression  (2.7)  In  the  form 

00  00 

a.)  =  5  r-'-dx  \  g,,  (o>.  m,.  (4.8) 

0  -An 

where 


Ox) 


0,w(».  "I,.  9,) 


Therefore,  the  equivalent  linear  transformation  for  a  nonlinear 
circuit  can  be  calculated  beforehand  depending  on  the  magnitude  of  the 
mathematical  expectation  and  the  standard  deviation  of  the  randcan  func¬ 
tion  at  the  Input. 

A  practical  method  of  detezmlnlhg  the  equivalent  linear  transform¬ 
ation  of  a  nonlinear  stationary  circuit  Is  the  experimental  deteztnlna- 
tlon  of  the  relation  of  the  Input  and  output  randcan  function  K^{x) 
according  to  the  scheme  In  Fig.  2  and  subsequent  calculation  of  the 
coefficient  ko,  ki  and  the  transfer  function  ^(p,  m,  a).  These  cal¬ 
culations  are  perfonted  by  the  following  fozmulas: 


(4.9) 

\r(T,  m,  0)-  m,  0)1 

OS 

(4.10) 

0(i»,  m,  9)  «  ii  n>'  (T.ffi,  o)e-'’"dx; 

• 

(4.11) 

9)  -  • 

'  m  00 

(4.12) 

J  W  (T,  m,  a)<^r 

0  j 
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Example.  Let  us  deteralne  the  equivalent  linear  transfomatlon 
with  respect  to  the  second  criterion  for  a  nonlinear  circuity  the 
equation  of  which  has  the  form 

(T/>H)y-Z,iign|X-V'l. 

When  *  m  »  const  and  X°(t)  which  Is  stationary  white  noise  having 
a  level  of  spectral  density  Qo>  let  the  value  lOy  and  the  function 
Ky^  (t,  m,  a),  where  o*  -  2irQo»  are  experimentally  determined  or  cal¬ 
culated.  The  function  Ky^  (t,  m>  o)  for  the  circuit  considered  can  be 
approximated  by  the  expression 

X„(t,  m,  o) A{m,  o)  *>**1. 


Fig.  ?.  Graphs  of  the  co¬ 
efficient  ki(o)  for  the  non¬ 
linear  circuit. 

Prom  the  above  formulas  (4.9)-{^.12)  we  will  determine  successfully 
the  coefficient  ko»  ki  and  the  transfer  function  ^  (p,  m»  a) 

*.  («.  9)  =  :  W'  (^.  «)  = 

A,(m,  «)  =  6(/n,  o)  -*-jj — ;  <P(p,  tn,  ’ 

Graphs  or  tables  can  be  compiled  for  coefficients  A(m«  o)  and  B(ai«  o) 
as  a  numerical  example  let  us  examine  the  ease:  L  >  1,  T  •  0.1«  jb  «  0. 


-14- 


In  this  case  my  -  0.  The  value  of  the  coefficient  B(0,  a)  coincides 
with  ki(o),  the  coefficient  A(0,a)  ■  o*ki(o).  The  graph  In  Pig.  5 
shows  the  dependence  of  the  coefficient  ki(o)  for  this  case. 

5.  The  Use  of  the  Theory  of  Statistical  Linearization  for 


a  Theoretical  Probability  Analysis  of  Nonlinear  Closed  Station 


Let  us  now  examine  a  closed  nonlinear  dynamic  system,  which  Is 
shown  In  Fig.  4.  We  will  write  the  equations  of  this  system  In  the 
form 

L{p)Z=X-Y;  Y^f(Z),  (5.1) 

where  f  Is  the  operator  of  the  nonlinear  circuit,  L(p)  Is  the  linear 
differential  operator.  Using  statistical  linearization  of  the  nonlin¬ 
ear  circuit,  we  will  derive  two  systems  of  equations.  The  first  sys¬ 
tem  for  determining  the  mathematical  expectations  of  the  functions  Is 

L  (/>)  m,  --  fUj,  —  m,:  *K  (/>,  m„  3,)  m,  =  k,/n„  (5*2) 

A 

where  T(p,  m^,  ^  y  Is  the  equivalent  linear  operator 

z  z 

of  the  nonlinear  circuit;  ko(m  ,  a  )  Is  the  statistical  coefficient  of 

z  z 

aiqpllflcatlon  of  the  nonlinear  circuit  with  respect  to  the  mathematical 
expectation. 

To  determine  the  random  components  of  the  functions  we  will  de¬ 
rive  the  system  of  equations 

2.,  (5.5) 

where  ki(mjg,  o^)  is  the  statistical  coefficient  of  amplification  of 
the  circuit  with  respect  to  the  random  coDQ>onent. 
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Fig.  4.  Block  diagram 
of  a  nonlinear  closed 
circuit. 


The  linear  theory  of  the  transformation  of  random  functions  Is 
fully  applicable  upon  Integration  of  systems  of  equations  (5.2)  and 
(5.5).  The  solution  of  these  equations  must  be  done  by  the  method  of 
successive  approximation  with  the  use  of  the  graphs  of  the  coefficient 
ko(m,  0),  ki(m,  a),  of  the  analytical  expressions  for  the  oi>erator 
f(p,  m,  a),  and  the  graphs  of  its  coefficients. 

ISie  theory  of  statistical  linearization  Is  fomally  extended  to 
linear  systems  of  discontinuous  automatic  control  by  replacement  of 
the  appropriate  continuous  type  of  differential  equations  by  equations 
In  finite  differences. 


Conclusions 

An  approximate  theoretical  probability  analysis  of  nonlinear  dy¬ 
namic  systems  based  on  the  theory  of  statistical  linearization  of  non¬ 
linear  operators  opens  broad  opportunities  in  the  Investigation  of  non¬ 
linear  continuous^  and  discontinuous  automatic  control  systems  for 
which  the  first  two  probability  moments  of  random  functions  are  suf¬ 
ficient  characteristics. 

Two  criteria  of  the  approximation  of  a  random  function  were  ex¬ 
amined;  1)  the  criterion  of  the  equality  of  the  first  two  probability 
moments  and  2)  the  criterion  of  the  minimum  of  the  mean  square  value 
of  the  difference  of  functions.  When  approximating  the  nonlinear 
operatort  the  second  criterion  is  more  siaqple  in  a  practical  sense. 


-16- 


Of  practical  value  Is  the  approximate  method  of  determining  the  equiva¬ 
lent  linear  operator  with  respect  to  the  second  criterion  based  on  an 
Input  signal  In  the  form  of  a  stationary  random  white  noise. 

A  combination  of  the  principle  of  statistical  linearization  with 
experimental  methods  of  deriving  the  dynamic  characteristic  of  a  non¬ 
linear  circuit  enables  us  to  investigate  real  components  whose  equa¬ 
tions  are  unknown.  Here  the  experimental  determination  of  the  dynamic 
characteristic  of  the  nonlinear  circuit  consists  of  calculating  the 
mutual  correlation  fvinctlon  of  the  output  and  input  upon  a  random 
signal  at  the  Input  In  the  form  of  a  stationary  white  noise.  A  normal¬ 
ized  mutual  correlation  function  coincides  with  the  weight  function  of 
an  equivalent  linear  operator. 

A  further  development  of  the  theory  of  statistical  linearization 
of  nonlinear  operators  should  apparently  be  carried  out  In  the  follow¬ 
ing  directions:  1)  an  Investigation  of  the  accuracy  of  the  method  of 
statistical  linearization  of  nonlinear  operators  and  the  obtalnroent 
of  the  fundsimental  and  practical  estimates  of  the  accuracy  of  the  cal¬ 
culation;  2)  an  Investigation  of  the  limit  of  the  application  of  the 
method  of  statistical  linearization  for  open  and  closed  dynamic  sys¬ 
tems;  5)  a  study  of  typical  cases  of  applying  the  principle  of  statis¬ 
tical  linearization  of  nonlinear  circuits  and  the  accumulation  of  fac¬ 
tual  material  on  the  equivalent  characteristics  (compilation  of  tables, 
graphs,  and  algorithms  of  the  calculation  of  equivalent  characteristics) 
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DISCUSSION 


Qaestlons 

I.  A.  Bol*8hakov  (USSR).  Of  considerable  Interest  are  closed 
systems  whose  nonlinearity  lies  In  an  element  separating  the  error 
signal.  If  the  characteristic  of  this  element  Is  at  Infinity  or  sim¬ 
ply  equals  zero,  then  a  stationary  distribution  of  the  error  of  trac¬ 
ing  does  not  exist  and  the  method  of  statistical  linearization  Is  de¬ 
prived  of  a  physical  meaning.  However,  In  one  of  the  recent  works  of 
Investigator  Kazakov,  the  method  of  linearization  was  applied  to  this 
type  of  ncmlinearlty.  Does  the  author  of  the  report  ccmslder  this 
legal? 

J.  M.  Mllsem  (Canada).  I  would  like  to  ask  Mr.  Kazakov  how  valid 

is  his  methods  for  dynamic  nonllnearltles  In  the  presence  of  a  closed 
control  circuit  which  now  by  definition  are  nonlinear?  As  we  are  all 
in  agreement,  the  distribution  of  the  probability  density  can  consid¬ 
erably  differ  frcmi  gausslan  which,  by  assumption.  Is  at  the  Input  of 
the  circuit.  * 

In  addition  does  the  author  have  any  ccmnents  relative  to  an 
analytical  forecast  of  the  distortion  of  the  distributions  of  the 
probability  density  In  these  nonlinear  closed  circuits? 
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Statements 


R.  L.  Stratonovlch  (USSR).  The  problem  of  statistical  lineariza¬ 
tion  Is  very  Important  for  an  analysis  of  statistical  processes  en¬ 
closed  automatic  control  systems  when  selecting  their  optimal  param¬ 
eters.  At  the  same  time  If  the  calculation  of  the  correlation  func¬ 
tions  needed  for  linearization  Is  a  problem  of  the  same  degree  of  dif¬ 
ficulty  as  the  Initial  problem  (which  must  be  solved  by  linearization) 
then  the  method  to  a  considerable  extent  Is  assured.  The  generaliza¬ 
tion  of  the  method  proposed  by  Kazakov  for  the  case  of  Inertia  trans¬ 
formation  requires  verification  from  this  point  of  view. 

Heretofore  insufficient  attention  has  been  devoted  to  the  limits 
of  applicability  of  the  method  of  statistical  linearization.  I  will 
attempt  to  enumerate  the  conditions  of  the  applicability  of  the  method 
and  the  possible  sources  of  errors  corresponding  to  them. 

1.  It  Is  necessary  that  the  higher  moments  (third,  fourth,  and 
others)  be  disregarded  for  the  problem  under  consideration. 

2.  It  Is  necessary  that  a  distribution  law  of  a  known  fom  be 

at  the  Input  of  the  nonlinear  element  In  spite  of  the  presence  of  feed 
back.  I.  Ye.  Kazakov  used  the  gausslan  law  of  distribution,  whereas 
In  nonlinear  systems  with  a  large  amplification  factor  yielding  a 
small  error  the  gausslan  law  does  not  take  place.  This  Is  shown  In 
particular  In  the  first  and  second  examples  of  Barret's  report. 
Fortunately  the  gausslan  law  Is  not  necessary  for  the  application  of 
the  linearization  method  In  the  generalized  form.  For  example.  In 
Barret's  exanqples  linearization  can  be  fulfilled  by  means  of  the  dis¬ 
tribution  laws  that  were  found.  Hence  we  see  that  linearization  Is  an 
effective  method  In  combination  With  other  methods  which  serve  to 
determine  the  probability  density.  Here  It  Is  necessary  mainly  to 
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mention  such  a  vigorous  method  of  analysis  of  Ineirtla  systems  as  the 
apparatus  of  the  Markow  processes. 

3.  The  following  shortcoming  has  heretofore  been  characteristic 
of  proposed  theories  of  linearization.  They  have  not  taken  into  ac¬ 
count  the  fundamental  difference  of  nonlinear  transfonnations  from 
linear  transformations  which  Is  manifested  in  the  nonlinear  case  by 
the  Inequality 

K„K„-Ki„>0  (1) 

(whereas  In  linear  transfonnations  this  magnitude  equals  zero).  This 
effect  can  be  called  "losses  of  correlation"  (In  contrast  to  "losses 
of  Infonnatlon"  which  does  not  occur).  As  a  consequence  of  this  In¬ 
equality  upon  replacing  the  nonlinear  transfoiinatlon  y  ■  f(x)  by  the 
linear  transfonnatlon  y'  »  a  +  Px  It  Is  Impossible  to  satisfy  with 
two  coefficients  the  three  equalities: 

^  =s  If;  Kf’M  —  Kftt  A/ If*  =  Kfft  ( 2 ) 

(Krt  =  S— oft). 

Two  variations  of  the  method  arise.  In  the  first  a  and  p  are  deter- 

»  Kyiyi#  In  the  second  they 
are  determined  by  means  of  equalities  y  »  y';  Ky^  »  third 

equality  remains  unsatisfied.  This  defect  can  be  eliminated.  We  will 
Introduce  A,  the  operator  destroying  the  correlation, and  we  will  find 
the  nonlinear  transfonnatlon  In  the  form 

y’  =  CIL  +  ^X  +  -(Ax  (3) 

(In  order  not  to  develop  specially  a  rule  with  action  with  operator  A, 
It  is  convenient  (In  the  stationary  phase)  to  take  It  In  the  form  of 
a  shift  operator  e"P^  for  a  certain  Indeteimlnably  large  time  Interval 
T).  !nien  the  three  magnitudes  can  satisfy  all  three  equalities  (2) 
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and  we  obtain: 


<*=  «/-(3  +  T)Jt;  ^  =  ^7':  T=— *4"^  (4) 

We  will  apply  this  method  to  example  2  of  Barret's  report.  The  con¬ 
trol  system  Is  described  by  the  equation 

x  +  aic  = -~f{x)  +  l.  ^5) 

We  will  set  T  ~  0}  »  N6(t);  f(-x)  =»  -f(x).  m  this  case  the  sta¬ 

tionary  distribution  (Bolta&ann  distribution)  has  the  form 

\Xit(x)^Ce  (u(jt)  = -J/(x)dx;  C-'  =  Je  '^dx). 

Therefore,  the  magnitude  entering  into  (4)  equal 


_  MX) 

i'  =  0;  Ky,^c\f(x)xe  ^  dx\ 

UU) 

K„„  =  C^f* (x)  e  ^  dx. 


(6) 


Substituting  (5)  and  (5)  and  solving  this  equation,  we  find  the  spec¬ 
tral  density  of  fluctuating  of  the  x-coordlnate 


S,(«)  = 


_ _ N 

(i(‘  (-  (a*  —  Z3)  •)•  +  p*  W  ‘ 


(7) 


If  we  use  the  Imperfect  method,  then  with  the  first  variant  the  term 
-2P  would  be  absent  In  the  demonlnator  of  expression  (7)  and  with  the 
second  variant,  the  term  7®. 

4.  When  perfomlng  linearization,  strictly  speaking  It  Is  neces¬ 
sary  to  satisfy  Inequality  (2)  In  which  the  .magnitude  x,  y  pertain  to 
>ne  Instant  of  tine,  and  the  corresponding  equalities  for  different 
instants  of  time  are: 

7(0  =  yT0;  =  (8) 
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or  In  the  statlcmary  case 


V'  -  'y\  K^m  (t)  -  (T);  (t)  -  (t);  (t  -  -  /,). 


Then  even  In  the  case  of  the  Inertia-free  nonlinear  transfoxnatlMi 
y  a  f  (x)«  approxlnatlon  (3)  will  be  replaced  by  the  inertia  transfons- 

atlon 

y(t)=>a{t)  +  ^nt.t’)x{ndr  +  A^x\t*.nx{ndt\  (9) 


where  p,  7  satisfy  equations: 

\?{t,s)K„(s',nds=^Ky,(t,ty, 

\  \  (3 (/.  s)  ? (/'.  s')  +  T (/.  s)  T (/'.  *')1  |K«  (s.  s') dsds'^K^ (/.  t'). 

V  « 


(10) 


An  Increase  In  the  accuz*acy  corresponding  to  a  change  to  a  ccoplete 
system  (8)  Is  associated,  however,  with  an  Increase  of  difficulties 
In  the  calculation.  She  main  difficulty  Is  to  find  the  correlation 

of  a  closed  system.  It  Is  necessary  to  note 
that  In  example  (7)  linearization  facilitates  determination  of  the 
unknown  correlation  function  of  the  x-coordlnates  and,  .consequently, 
the  variable  As  for  equations  (lO),  In  the  stationary  case  they 
can  by  the  method  of  the  Fourier  transform.  Since  we  are  dealing 
with  a  calculating  method,  we  need  not  observe  the  condition  of  the 
physical  realization  of  transformation  (9)» 

J.  F.  Barret  (England).  I  wish  to  cite  the  work  of  Dr.  A.  T. 
Fuller  where  the  problem  of  statistical  linearization  for  this  speci¬ 
fic  exainple  Is  examined. 

S.  S.  L.  Chan  (USA).  I  was  greatly  Inpressed  by  the  comment  of 
Mr.  Stratonovlch  concerning  the  loss  of  correlation  In  nonlinear  sys¬ 
tems.  However,  I  have  certain  doubts.  While  the  output  magnitude  2. 
Is  as  a  whole  determined  by  the  Input  noise  |,  heretofore  y  and  %  have 
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been  correlated  In  the  strict  sense  of  this  word,  nie  loss  of  coxTel- 
atlon  sooner  occurs  because  of  the  method  of  detexnlnlng  correlation 
functions  of  the  second  order  than  because  of  an  actual  loss  of  cor¬ 
relation  between  two  signals. 

Another  point  of  view  of  this  problem  Is  associated  apparently 
with  the  use  of  gausslan-type  signals  for  which  the  Joint  distribution 
Is  fully  determined  by  correlation  functions  of  the  second  order* 
which  la  Invalid  for  random  signals  of  another  type.  Correlation 
functions  cannot  represent  signals  In  nonlinear  systems  like  they 
represent  signals  In  linear  systems.  In  nonlinear  systems  even  with 
an -Input  signal  with  a  gausalan  distribution*  the  distribution  of  the 
output  magnitude  Is  not  gausslan. 

A.  A.  Pervozvanskly  (USSR).  ISie  problem  of  the  limits  of  the 
applicability  of  the  statistical  linearization  method  has  two  sides: 

1)  a  revelation  of  the  possibilities  of  the  method  assuming  that  the 
distribution  laws  differ  from  normal;  2)  determination  of  a  class  sys¬ 
tem  for  which  the  method  Is  effectively  applicable. 

The  second  question  concerns  the  need  to  establish  the  dlffexmnce 
between  the  distribution  laws  at  the  output  of  a  circuit  consisting  of 
Inertla-free  nonlinearity  and  a  linear  filter.  An  estimate  of  the 
difference  with  respect  to  higher  moments  Is  difficult. 

It  Is  expeditious  to  use  the  extreme  property  of  entropy  of  a 
normal  process  established  by  Shaimon.  Somewhat  generalizing  It  we 
can  assert  that  the  normal  process  has  the  highest  entropy  per  degree 
of  freedom  among  all  processes  having  an  Identical  determinant  com¬ 
posed  of  correlation  function. 

A  calculation  of  the  entr>opy  at  the  output  of  the  aforementioned 
circuit  Is  not  too  coiqplex.  The  expression  for  entropy  of  a  normal 
process  with  a  given  correlation  determinant  was  given  by  Shannon. 


A  con^arlson  of  these  expressions  permits  us  to  answer  the  problem 
concerning  the  degree  of  normalization.  Such  an  application  of  the 
methods  of  the  Information  theory  can  be  of  substantial  Interest. 

J.  K.  Lubbock  (England).  I  have  two  comments  relative  to  this 
report. 

1.  The  author  asserts  that  when  using  .the  second  criterion  for 
an  Inertla-free  nonlinear  element  In  a  stationary  system  at  the  out¬ 
put  of  which  the  signal  has  its  gausslan  distribution#  the  equivalent 
linear  operator  becomes  Inejrtla-free;  this  result  was  proved  by  Nuttall 
[l]  for  a  more  general  class  of  Input  processes  which  he  called  a 
separable  class.  This  Is  valid  also  for  an  even  more  general  seml- 
separable  class*  of  processes  [2]. 


2.  A  method  of  approximation  of  such  a  kind  Is  extremely  valu¬ 
able  for  analysis  and  synthesis  of  nonlinear  systems#  In  particular 
nonlinear  closed  systems#  but  one  should  be  very  careful  when  using  It 
since  such  cases  can  be  encountered  where  the  error  of  approximation 
can  not  be  disregarded.  I  don't  know#  did  the  author  Investigate  the 
order  of  error  which  should  be  expected  In  any  specific  practical  sit¬ 
uation.  In  one  of  his  early  works,  Booton  [^]  cited  an  example  of  a 
closed  system#  shown  In  the  figure#  which  proved  to  be  unsatisfactory 
because  the  error  of  the  system  was  about  jO  times  greater  than  the 

*  It  Is  not  clear  In  what  respect  these  classes  pertain  to  sep¬ 
arable  randmn  processes  detemlned  In  mathematics.  See  for  example 
J.  L.  Dub#  probability  processes.  ILL#  N.  #  19^*  (Editors  comment). 
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magnitude  of  the  Input  signal.  In  such  an  unreal  case  the  Input  sig* 
nal  of  the  nonlinear  limiting  has  almost  a  gausslan  distribution  (If 
the  signal  at  the  Input  of  the  system  Is  gausslan )>  but  If  ampllflca- 
tlon  of  the  limiter  IncTOases  or  the  tljne  constant  of  the  Integrator 
decreases  so  that  It  operates  more  satisfactorily  as  a  repeator,  then 
the  method  of  linearization  leads  to  an  equivalent  system  which  Is  a 
very  poor  approximation  of  the  Initial  nonlinear  system. 
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V.  S.  Pugachuv  (USSR).  fRie  method  of  statistical  linearization 
Is  In  essence  an  approximate  method.  Therefore,  It  can  be  used  only 
for  an  approximate  physical  analysis  of  nonlinear  systems.  This 
method  In  principle  Is  Inapplicable  for  an  exact  solution  of  such 
problems  as,  for  example,  determination  of  the  distribution  laws  of 
parameters  of  state  of  a  nonlinear  circuit.  It  should  be  considered 
from  this  point  of  view.  • 

'  I 

The  Idea  of  the  method  of  statistical  linearization  Is  fully 
analogous  to  the  Idea  of  the  method  of  haxnonie  linearization  or  har- 

aonio  balanoe  in  the  determinietlo  theory  of  nonlinear  syeteae.  Both 

« 

these  methods  are  convenient  practical  Instruments  for  an  approximate 

» 

calculation  of  nonlinear  systems.  This  ejqplains  the  extensive  prac¬ 
tical  use  of  the  method  of  harronio  linearization,  the  ever  growing 
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Interest  in  the  method  of  statistical  llnearlsati(m«  and  the  great 
number  of  works  devoted  to  this  method  and  its  application  which  have 
appeared  recently  in  various  countries.  The  report  of  Kazakov  gave  a 
further  generalization  of  this  method  which  took  into  account  the  dis¬ 
tortion  of  the  correlation  function  upon  propagation  of  random  func¬ 
tions  through  nonlinear  elements. 

From  a  practical  point  of  view  it  is  l^ortant  that  when  using 
the  general  method  of  statistical  linearization  described  by  Kazakov* 
we  can  perform  statistical  linearization  of  nonlinear  elements  directly 
from  the  experimental  data. 

It  should  be  noted  that  the  improvements  in  the  method  of  statis¬ 
tical  linearization  proposed  here  in  the  report  of  R.  A.  Stratonovich 
did  not  yield  anything  new  in  cooqparison  with  the  general  method  of 
statistical  linearization  proposed  in  the  report  of  Kazakov*  since  the 
formula  for  the  output  signal  of  the  approximate  linear  element  taken 
by  Stratonovich  is*  evidently*  a  spectral  case  of  the  more  general 
foroDula  contained  in  Kazakov's  report. 

I.  Ye.  Kazakov  answers  questions  asked  of  him. 

Question.  Is  it  possible  to  determine  the  law  of  the  distribu¬ 
tion  of  a  random  process  at  the  input  to  a  nonlinear  element  in  a 
closed  system  by  using  the  method  of  statistical  linearization? 

Answer.  By  using  the  method  of  statistical  linearization  it  is 
impossible  in  principle  to  determine  the  distribution  law  at  the  in¬ 
put  to  a  nonlinear  element  in  a  closed  circtilt.  For  this  purpose  we 
need  a  more  coeq;>lete  and  accurate  method. 

Question.  Can  the  method  of  statistical  linearization  be  used 
for  nonlinear  elements  having  characteristics  of  a  type  of  assynptotic 
curve? 
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Answer.  In  principle  the  eqialvalent  statistical  coefficient  of 
aiqpllflcatlon  can  he  detexnlned  for  any  nonlinear  dependences.  These 
etatlstlcal  coefficients  of  simplification  have  a  statistical  sense. 

Question.  In  what  oases  can  we  use  the  usual  oethod  of  statisti¬ 
cal  linearization  when  examining  Inertla-free  nonllnearltles  In  a 
closed  system  and  In  what  cases  Is  It  necessary  to  use  the  generalized 
theory  presented  In  the  report? 

Answer.  When  estimating  the  stability  of  a  closed  circuit  having 
nonlinear  elements  It  Is  necessary  to  use  the  more  complete  statisti¬ 
cal  characteristics  of  nonlinear  elements  which  take  Into  account  the 
changes  of  the  spectrum  upon  propagation  of  a  signal  through  the  non¬ 
linear  element. 
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